Methods and Metrics for the Evaluation of Dictation Systems: a Case Study
نویسندگان
چکیده
This paper describes the practical evaluation of two commercial dictation systems in order to assess the potential usefulness of such technology in the specific context of a translation service translating legal text into Italian. The service suffers at times from heavy workload, lengthy documents and short deadlines. Use of dictation systems accepting continuous speech might improve productivity at these times. Design and execution of the evaluation followed the methodology worked out by the EAGLES Evaluation Working Group. The evaluation therefore also constitutes a test bed application of this methodology.
منابع مشابه
Evaluation of recommender systems: A multi-criteria decision making approach
The evaluation and selection of recommender systems is a difficult decision making process. This difficulty is partially due to the large diversity of published evaluation criteria in addition to lack of standardized methods of evaluation. As such, a systematic methodology is needed that explicitly considers multiple, possibly conflicting metrics and assists decision makers to evaluate and find...
متن کاملReview of ranked-based and unranked-based metrics for determining the effectiveness of search engines
Purpose: Traditionally, there have many metrics for evaluating the search engine, nevertheless various researchers’ proposed new metrics in recent years. Aware of this new metrics is essential to conduct research on evaluation of the search engine field. So, the purpose of this study was to provide an analysis of important and new metrics for evaluating the search engines. Methodology: This is ...
متن کاملThe Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملCognitive Behavior Therapy Programing: Evaluation of Effectiveness on Learned Helplessness by Students with Special Learning Disabilities (Dictation)
Introduction and Aim: Children with special learning disability of dictation often have low self-efficacy, which is mainly due to academic failure and difficult perception. The aim of this study was to evaluate the effectiveness of cognitive behavioral therapy intervention on learned helplessness of students with special learning disabilities (dictation). Methods: The research method in this q...
متن کاملSpatial Evaluation of Energy Performance at Neighborhood Scale Case study: Sanandaj city
Climate change has become a challenge with adverse impacts on the Earth. Reducing the use of fossil fuel is a primary step to solve environmental problems. As the population continues to rise, to meet the growing demand for construction with a large share in energy Consumption, Efforts to make the built environment more energy efficient is crucial. The main objective of this research is to eval...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000